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V  INTRODUCTION 

'J. 

The  purpose  of  this  report  is  tMofold.  It  provides  an 
introduction  to  the  Range  Data  Measurement  System  (RDMS)  log  data 
from  the  National  Training  Center  (NTC)  and  it  provides  a 
comparison  of  the  tMO  NTC  digital  data  sources,  Core 
Instrumentation  Subsystem  (CIS)  log  tapes  and  RDMS  log  tapes. 

The  report  is  divided  into  four  sections.  Section  1 
describes  the  data  sources  and  the  types  of  data  that  may  be 
expected  from  each.  Section  2  documents  methodology  used  in 
comparing  the  two  sources,  including  identification  of  specific 
mission  segments  selected.  Section  3  presents  the  results  of  the 
analysis,  both  at  the  micro  level,  for  the  selected  mission 
segments,  and  at  the  macro  level,  with  some  collective  statistics. 
Finally,  section  4  is  the  conclusion. 


I.  NTC  INSTRUHENTEO  DATA 


The  NTC  Instrueentation  Systea  (NTC-IS)  supports  the 
collection  and  retention  of  data  at  the  National  Training  Center. 
The  NTC-IS  consists  of  four  aajor  subsystems,  all  of  which  are 
involved  to  some  extent  in  the  collection  of  digital  data: 

(1)  The  Range  Data  Measureaent  System  (ROMS). 

(2)  The  Core  Instrumentation  Subsystem  (CIS), 

(3)  The  Live  Fire  Subsystem  (LFS).  and 

(4)  The  Range  Monitoring  and  Communications  Subsystem  (RMCS) 

The  ROMS  and  CIS  are  the  subsystems  principally  involved  in 
digital  data  collection  at  the  NTC.  Figure  I-l  shows  the 
interrelationships  of  the  relevant  components  of  the  ROMS  and  CIS 
relating  to  data  collection. 

Data  collected  at  the  NTC  can  be  divided  into  three  general 
categories:  raw  field  data,  data  input  manually,  and  data  derived 
from  either  or  both  of  the  prior  two  categories. 

Raw  field  data  are  collected  by  the  ROMS;  input  data  are 
entered  via  components  of  the  CIS.  and  data  elements  are  derived 
by  both  subsystems. 

1^1.:.  Qlla  Collecigd^  Logged  by  itlft  R&Hi 

The  ROMS  collects  "real  time"  data,  meaning  that  each  ROMS 
data  element  is  retrieved  as  soon  after  it  happens  as  possible, 
constrained  only  by  the  limits  of  the  instrumentation  systems. 

Raw  field  data  events  collected  by  the  ROMS  include  trigger 
pull  (fire  event)  with  associated  ammunition  remaining  messages, 
laser  illumination  (pairing),  and  microphone  key  pressed/ 
released.  In  addition  to  the  event  data,  the  ROMS  collects  raw 
ranging  data  from  which  position/  location  is  derived  for  each 
instrumented  player. 

The  ROMS  provides  one  source  of  archival  data  from  the  NTC. 
Data  elements  logged  from  the  Position/  Tracking  Computational 
Component  (PTCC)  of  the  ROMS  are  listed  in  Figure  1-2. 

ROMS  data  are  as  accurate  as  the  reliability  of  the 
collecting/  transmitting  hardware  allows.  The  complexity  of  NTC 
field  instrumentation  is  conducive  to  a  wide  variety  of  error- 
producing  conditions,  including: 

(1)  Spurious  RF  transmissions,  leading  to  erroneous  events, 

(2)  "Noisy"  laser  sensors  which  generate  spurious  and/or 
inaccurate  pairing  events; 

(3)  Hardware/electronic  player  instrumentation  problems 
leading  to  loss  or  duplication  of  valid  events,  and  the 
generation  of  invalid  events;  and 
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Figure  I-l  NTCIS  Subsystems 


DATA  ELEMENT 


DESCRIPTION 


Trigger  Pull 


Ammunition  Remaining 

Laser  Illumination 


Communication 


Live  Fire 


Position  /  Location 


Player  Status 


Event  received  when  a  shot  is  fired  by  an 
instrumented  weapon  system.  Event  data 
consist  of  flrer  player  number  and  weapon 
type. 

Pair  of  events  received  immediately 
following  trigger  pull.  Tens  digit  m 
former  message,  units  in  latter. 

Event  sent  by  target  (player  being  lased.) 
This  event  type  is  one  of  three  differ¬ 
ent  kinds  of  codes,  for  HIT.  NEAR  MISS, 
and  KILL.  For  a  HIT  message,  event 
indicates  general  type  of  weapon.  For 
near  MIsS  and  KILL  more  exact  weapon 
type  information  is  included. 

An  event  is  sent  by  a  player  whenever 
the  microphone  key  for  either  net  is 
depressed  or  released.  The  message 
includes  the  net  (1  or  2)  and  the 
action  (depress  =  on.  release  =  off). 

There  are  four  Live  Fire  events  passed 
from  the  targets  via  ROMS.  They  are: 
target  UP.  target  DOWN.  HIT  by  bal¬ 
listic  projectile,  and  HIT  by  Laser. 

The  Position /Location  of  each  in¬ 
strumented  player  is  derived  by 
Roms  software  from  raw  Range  Data 
and  logged. 

Player  Status  initialization  and  updates, 
which  are  entered  from  the  CIS  and  trans¬ 
mitted  to  the  ROMS  are  also  logged. 

These  data  include  the  B-Unit  Player 
identification/weapon  system  assign¬ 
ment. 


Figure  1-2  Data  Eleeents  Logged  by  the  ROMS 
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(4)  Coverage  problems  resulting  in  the  loss  of  track  of 
instrumented  vehicles  and  the  corresponding  loss  of 
position/  location  and  event  retrieval  capability. 

Even  in  the  case  of  perfect  hardware  performance,  it  is 
possible  for  errors  to  be  introduced  by  faulty  initialization.  If 
the  proper  B-unit  code  is  not  associated  with  the  right  player 
identification,  incoming  events  will  be  improperly  assigned  or  may 
be  deleted  as  invalid.  Such  problems  can  quickly  lead  to  a 
serious  loss  of  data  integrity. 

ij-ij-i  EDMS  Log  Data  Processing 

Processing  of  the  ROHS  log  tapes  is  accomplished  by  using  the 
ARI-POM  developed  program  GOETAP,  which  reads  ROMS  log  tapes  and 
creates  three  different  reports: 

(1)  Event  lists,  including  firing  and  pairing  data, 

(2)  Commo  report  including  the  duration  in  seconds  of  each 
radio  transmission,  and 

(3)  Player  report,  which  shows  the  correspondence  between 
ROMS  player  numbers  and  B-units. 

Various  VAX  utilities  can  be  used  to  reprocess  the  basic 
report  files  to  yield  a  variety  of  files  and  reports.  A  complete 
description  of  program  GOETAP  is  contained  in  the  document  Program 
GQETAP  Ogcument align ,  (Briscoe,  1985). 

Ij.2  Data  figiiected/  Logged  by  tjie  CIS 

The  Core  Instrumentation  Subsystem  (CIS)  is  the  heart  of  NTC 
instrumented  operations,  serving  as  the  interface  between  the 
trainers  and  the  field  operations. 

The  CIS  performs  several  functions  related  to  the  collection/ 
generation  of  NTC  digital  data: 

(1)  The  Interactive  Display  and  Control  Component  (IDCC) 
provides  the  interface  between  Exercise  Monitoring  and  Control 
(EMC)  and  Training  Analysis  and  Feedback  (TAF)  personnel  and  the 
ongoing  exercise(s). 

(2)  The  CIS/IDCC  also  supports  pre-exercise  initialization 
which  includes  entry  of: 

(a)  Player  initialization  information, 

(b)  Control  measure  information, 

(c)  Task  Force  organization, 

(d)  Live  Fire  scenarios,  and 

(e)  Pre-planned  artillery. 

(3)  The  lOCC  provides  real-time  control  of  the  Live  Fire 
Exercises  (LFX)  by  the  Live  Fire  Control  Officer  (LFCO). 

(4)  The  CIS  Computational  Component  is  used  to  pair  firers 
with  targets  for  real-time  engagement  simulation. 


(5)  The  CIS  provides  computing  capacity  for  real-time  data 
manipulation,  such  as  the  calculation  of  statistical  measures  and 
unit  roll-up  totals. 

(6)  The  CIS  logs  data  in  real-time  to  provide  the  primary 
archival  source  of  NTC  data. 

Figure  1-3  lists  NTC  data  logged  by  the  CIS,  noting  data 
elements  that  are  logged  by  both  the  ROMS  and  the  CIS.  Many  of  the 
elements  logged  from  the  CIS  are  manually  input  data  elements. 
Reliability  of  manual  data  depends  upon  the  accuracy  of  the 
personnel  entering  the  data  and  the  verification  procedures  that 
are  employed,  such  as  proofreading  and  consistency  checks. 

£iS  Log  Data  Prgcessingi  The  NTC  Database  Research  System 

The  NTC  Database  Research  System  (NTCDRS)  mas  developed  for 
ARI/POM  to  facilitate  analysis  of  NTC  data.  The  heart  of  the 
system  is  the  INGRES  relational  database  system,  which  allows  the 
researcher  freedom  in  the  ways  he  can  formulate  queries  and 
generate  reports.  The  NTC  Database  Research  System,  then,  is  the 
means  by  which  NTC  CIS  log  data  for  one  mission  are  converted 
into  the  INGRES  data  base  format.  The  system  consists  of  two 
major  steps,  TRANSLATE  and  LOAD.  Figure  1-4  shows  the  processing 
flow  of  the  NTCDRS. 

The  TRANSLATOR  converts  the  binary  formatted  NTC  data  from 
one  mission  segment  into  a  man-readable  ASCII  (text)  file.  The 
output  from  the  TRANSLATOR  consists  of  three  files,  a  LOG  file 
summarizing  the  operations  performed  by  the  program,  a  HOLD  file, 
which  lists  the  message  types  not  processed  by  the  program,  and 
the  ASCII  DATA  file.  The  ASCII  file  can  be  read,  edited,  or 
processed  by  VAX  system  utilities,  and  serves  as  the  input  file 
for  the  LOAD  process. 

The  LOAD  consists  of  two  separate  FORTRAN  programs,  LOADER 
and  DBCOPY.  The  LOADER  program  converts  the  DATA  file  created  by 
the  TRANSLATOR  into  a  series  of  63  files,  each  of  which  relates 
directly  to  one  or  more  INGRES  tables.  Each  file  is  an  ASCII  file 
that  can  be  printed,  edited,  or  processed  by  other  programs.  The 
DBCOPY  program  reads  the  63  files  into  61  INGRES  tables.  Figure 
1-5  shows  the  relationship  between  the  files  output  by  LOADER  and 
the  INGRES  tables  created  by  DBCOPY. 

The  result  of  NTCDRS  processing  is  an  INGRES  database  for 
each  mission  segment  processed. 
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Figure  1-3  Data  Elesients  Logged  by  the  CIS 
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41 

CASLOO 

HLD 

42 
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43 
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44 
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UNTRAN 
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FIRPAR 
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Figure  1-5 


INGRES  Tables  vs.  Loader  File  Nanes 
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II .  STUDY  METHODOLOGY 


This  chapter  is  divided  into  two  parts.  The  first  part 
data  chosen  for  analysis  and  the  second  part 
methodology  used  to  compare  the  two  data  sources 


discusses 

the 

documents 

the 

NIC 

fi^ta 

The 

data 

rotation 

dur  i 

which  form  the  basis  of  this  report  were  from  a 
tg  FY  85.  Figure  II-l  shows  the  times  and  dates  for 
a11  missions  executed  during  the  rotation.  Dates  are  coded  to 
preclude  identification  of  a  specific  unit. 


Selection  of  Data  for  Detai  led  Analysis 


Three  mission  segments  were  selected  for  detailed  comparison. 
The  criteria  for  selection  were  as  follows: 

1)  Selected  segments  should  be  event-rich,  in  order  to 
provide  as  many  chances  for  agreement/  disagreement  as  possible. 

2)  In  order  to  facilitate  processing  of  RDMS  data,  segments 
should  be  selected  which  are  not  running  concurrently  with  the 
other  task  force.  If  concurrent  exercises  are  selected,  it  is 
difficult  to  assign  field  events  to  the  proper  task  force, 

3)  Selected  segments  should  be  somewhat  separated  in  time,  to 
enable  assessment  of  improvement  or  degradation  in  data  quality 
over  time. 

4)  Both  task  forces  should  be  examined. 

The  three  mission  segments  selected  were:  (1)  Mechanized  Mission 
Segment  08.  Day  4,  (2)  Armored  Mission  Segment  12,  Day  7,  and 

(3)  Mechanized  Mission  Segment  19,  Day  13.  For  reasons  of 
expediency,  the  three  segments  will  be  referred  to  as  M008,  A012, 
and  M019,  respectively,  within  the  text. 


While  the  time  distribution  was  not  optimal  because  of  the 
paucity  of  events  in  the  early  mission  segments,  the  other 
criteria  were  fairly  well  satisfied. 


The  detailed  comparisons  focus  on  two  kinds  of  data  that 
occur  abundantly  in  both  sources: 

1)  ElElDfl  Qlta  are  initiated  by  MILES  trigger  pull  events 
received  via  the  RDMS.  These  events  are  logged  by  the  RDMS  and 
transmitted  to  the  CIS,  where  they  are  also  logged.  The  NTCDRS 
creates  a  FIRING  table  which  can  be  compared  directly  with  RDMS  data. 

2)  Pairing  Data  are  initiated  by  MILES  sensor  illumination 
events  (HIT,  NEAR  MISS,  KILL)  received  via  the  RDMS.  They  are 
logged  by  the  RDMS  and  transmitted  to  the  CIS.  CIS  software 
attempts  to  correlate  each  pairing  event  with  a  valid  fire  event 
that  occurred  within  a  reasonable  time  of  the  pairing.  Both 
correlated  and  uncorrelated  pairing  events  are  written  to  the  CIS 
log.  The  NTCDRS  creates  a  PAIRING  table  with  all  pairing  events 
initiated  by  combat  fire  events,  including  the  firer  ID  if  known. 
Controller  gun  kills  present  in  the  RDMS  data  should  be  present  in 
the  NTCDRS  PLYRCHANGE  table. 
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Figure  II-l  Selected  Rotation  Mission  Segments 
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Due  to  the  tlee  required  for  the  FIRING  and  PAIRING  data 
coeparisons,  short,  event-rich  periods  within  each  of  the  selected 
segeents  were  chosen  for  detailed  comparison. 

Description  of  CIS  Log  iNTCDRSl  Source  Data 

The  NTCDRS  data  used  In  this  study  were  extracted  from  tables 
In  the  INGRES  data  bases  containing  data  for  the  mission  segments 
selected  for  analysis.  The  tables  used  from  these  databases 
Included  the  FIRING,  PAIRING,  and  PLYRCHANGE  tables.  These  tables 
are  described  below: 

FIRING  -  This  table  Includes  stream  data  messages  which  are 

created  based  upon  weapon  firing  Information 
received  from  the  RDMS  system.  The  firing 
Information  Is  used  by  the  NTC  software  for  pairing 
firings  with  effects,  as  described  below  In  the 
definition  of  the  Pairing  table.  In  addition, 
firing  messages  are  utilized  In  the  NTC  software  to 
generate  firing  alerts.  Since  the  firing  data  are 
tied  to  the  Instrumentation  system,  only  those 
weapons  equipped  with  the  MILES  system  and 
possessing  B-unIts  can  generate  a  firing  message. 

PAIRING  -  This  table  defines  how  weapon  firing  events  were 
paired  with  weapon  effects  events.  This  pairing 
Information  Is  used  In  the  NTC  software  In  the 
computation  of  ground  player  performance  statistics 
and  alert  messages.  Weapon  target  pairing  Is 
performed  using  time  coincidence  and  the  firer’s 
weapon  type  code  as  determined  from  the  LASER  code 
recieved  by  the  target.  In  cases  where  the  firer's 
weapon  type  code  In  the  firing  message  does  not 
uniquely  Identify  the  weapon  type  which  fired,  the 
player's  ID  Is  used  to  obtain  a  predetermined 
weapon  type  associated  with  the  particular  player. 

PLYRCHANGE  -  This  table  Includes  all  stream  data  messages  which 
define  the  Player  Status. 

The  FIRING  table  was  compared  directly  with  firing  data  read 
from  the  RDMS  log  tape;  the  PAIRING  and  PLYRCHANGE  tables  were 
used  In  trying  to  match  RDMS  log  pairing  data. 

Description  of  RfiMS  kaa  Source  Daia  . 

The  RDMS  log  data  for  the  rotation  are  contained  on  21 
magnetic  tapes.  The  exact  time  period  covered  by  these  tapes 
begins  at  21:39  on  Day  1,  and  ends  at  09:21  on  Day  15.  In 
general  the  data  are  continuous  with  two  exceptions,  a  gap  of  over 
sixteen  hours  between  tapes  two  and  three,  and  a  gap  of  over  four 
hours  between  tapes  five  and  six.  Otherwise,  the  time  between 
tapes,  during  which  data  were  not  recorded  by  the  ROMS,  ranges 
from  two  seconds  to  almost  fifteen  minutes.  Figure  II-2  Is  a 


graphic  depiction  of  the  tiae  period  for  which  data  were  recorded 
on  each  tape  in  the  series,  and  the  table  below  lists  the  tine 
period  covered  by  each  tape. 
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Oay 

12 

07 

54 

36 

2 

08 

16 

Day 

12 

08 

00 

47 

Oay 

13 

04 

05 

08 

6 

11 

17 

Day 

13 

04 

05 

04 

Day 

13 

08 

45 

15 

0 

04 

18 

Day 

13 

08 

52 

12 

Oay 

14 

03 

59 

13 

6 

57 

19 

Day 

14 

04 

04 

48 

Oay 

14 

12 

49 

34 

5 

35 

20 

Oay 

14 

13 

04 

20 

Oay 

15 

07 

33 

53 

14 

46 

21 

Day 

15 

07 

33 

51 

Oay 

15 
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ROMS  data  are  logged  without  reference  to  specific  nissions 
so  tables  in  the  NTCORS.  which  are  nission-  based,  can  be 
correlated  with  ROMS  data  only  by  using  tine  of  day. 

NTCORS  data  are  task  force  specific,  while  ROMS  data  are 
in  the  case  of  concurrent  exercises  (both  task  forces  running 
engagenent  sinulation  exercises  sinu 1 taneous 1y ) .  ROMS  data  contain 
events  fron  both  task  forces. 


Furthermore 
not.  so 


liii  Methodology 


The  basic  nethodology  enployed  in  this  study  was  the 
conparison  of  listings  fron  the  two  sources  (ROMS  log  and  NTCORS) 
to  isolate  the  elenents  which  conpared  and  did  not  conpare.  For 
those  elenents  which  were  not  conparable.  an  effort  was  nade  to 
explain  the  differences.  The  najor  thrust  of  this  effort  was  to 
assess  the  fidelity  with  which  ROMS  data  were  received,  processed, 
and  stored  by  the  CIS.  Accordingly,  the  enphasis  in  explaining 
differences  was  directed  toward  ROMS  data,  and  in  tracking  down 
the  reasons  those  data  did  not  appear  in  the  NTCORS  tables.  Less 
effort  was  directed  the  other  way.  in  deternining  why  data  that 
appear  in  the  NTCORS  tables  are  not  on  the  ROMS  log  tapes. 

Various  tools  were  used  to  assist  in  this  effort,  including  system 
editors,  the  VAX  sort  routine,  and  a  number  of  FORTRAN  programs. 
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Figure  II-2  Saeple  Rotation  ROHS  Tape  Coverage 
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Basic  filas  that  contained  ROMS  data  mere  generated  by 
executing  prograe  GDETAP  for  each  of  the  21  ROMS  tapes  containing 
data  for  the  rotation.  Figure  11-3  diagraes  the  processing  Mhich 
resulted  in  RDHS  files  that  Mere  directly  conparable  with  NTCORS 
tables.  In  order  to  einieize  tape  reading  operations,  each  tape 
Mas  read  only  once,  and  the  eaxieue  aeount  of  data  Mas  recovered. 
The  generated  files  Mere  then  split  into  tMO  specific  types, 
Firing  and  Pairing,  to  facilitate  coeparisons  Mith  NTCDRS  data. 
Then,  because  the  ROMS  tape  periods  do  not  correspond  to  the  tine 
periods  covered  by  the  selected  Mission  segnents.  the  files  Mere 
reconbined  so  that  they  covered  the  exact  tine  periods  of  the 
target  Mission  segnents.  At  this  point  tine-ordered  ROMS  files 
Mere  available  Mhich  had  analogous  tables  Mithin  the  NTCDRS. 

li.:.2.i.2  fientrfttion  of  HICQES  Files 


CIS  log  files  Mhich  Mere  utilized  in  this  study  Mere  listings 
of  tables  generated  by  the  NTCORS  process,  Mhich  Mas  briefly 
described  in  Chapter  1. 


i 
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21  RDMS  Tape#  for  Rotation  85-10 


Read  Each  Tape  1  Time 


21  Event/Commo  Combined  Files 


Split  Each  Combined  File 


21  Commo  Files 
21  Fairing  Files 
21  Firing  Files 


Combine  Tape  Files 
by  Time  to  Create 
Files  for  Three 
Individual  Mission 
Segments 


cessing  FIom 
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III.  RESULTS 


This  section  presents  the  results  of  the  analyses.  It  is 
divided  into  two  parts.  The  first  part  presents  the  results  of  an 
investigation  into  overall  error  rates,  and  deals  with  the  entire 
set  of  ROMS  data.  The  subsequent  section  docueents  the  results  of 
■ore  detailed  analyses  of  the  three  specific  Mission  segaents,  and 
include  four  reports: 

1)  Comparison  of  fire  events. 

2)  Conparison  of  pairings. 

3)  "Killers"  deMonstrat ion  for  the  three  segments,  and 

4)  Delay  time  analysis  for  the  three  segments. 

III.:.!  Invalid  Messages 

The  initial  study  undertaken  on  the  ROMS  log  data  was  on  the 
number  of  invalid  events  contained  in  the  data.  Event  codes  are 
bit  patterns  received  by  the  ROMS,  but  not  all  patterns  represent 
legitimate  events  at  the  NTC/ROMS.  and  were  classed  as  invalid 
events.  No  investigation  was  made  into  a  second  class  of  invalid 
events,  those  which  were  supported  by  the  ROMS  ,  but  not  for  the 
player  which  generated  the  event.  The  results  indicated  an 
overall  error  rate  of  less  than  one  percent,  with  individual  tapes 
ranging  from  0.29  percent  up  to  1.2  percent.  Furthermore,  the 
error  rates  do  not  appear  to  differ  significantly  from  the 
beginning  of  the  rotation  to  the  end.  The  table  below  presents  a 
list  of  the  error  counts  and  percentages  for  each  ROMS  tape  and 
in  total. 
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325 
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72 
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0.87 

13 
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0.81 
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236 

0.92 
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288 
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0.62 

20 
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21 
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0.85 

Figure  IIl-l  -  Invalid  Messages 


1 1 1 . 2  AnaJifses  of  Sfiscific  Mission  Segwent  Data 

The  following  analyses  were  based  on  none  detailed  studies  of 
three  mission  segments,  Mechanized  Task  Force  segments  8  and  19 
and  Armored  Task  Force  segment  12.  Specific  terms  which  are  used 
in  the  text  and  tables  require  definition;  they  are  defined  below: 

LPN  -  Logical  Player  Number.  This  is  an  index  that  is  used 
within  the  ROMS  data  to  refer  to  a  specific  player  or  vehicle.  It 
is  an  integer  between  1  and  500  and  may  be  assumed  to  be  assigned 
to  a  specific  ROMS  transponder  (B-unit).  Conversely,  each  B-unit 
is  assigned  one  and  only  one  LPN. 

Eifi  “  Player  Identification.  This  refers  to  the  name  by 
which  each  player  or  vehicle  is  identified  within  the  CIS  log. 

The  PID  is  a  3-character  alphanumeric  name.  The  term  "bumper 
number"  is  used  interchangeably.  Ideally,  each  LPN  should  refer 
to  one  and  only  one  PIO,  and  PIOs  should  be  unique.  Neither 
condition  is  true.  Occasionally,  the  PID  for  a  BLUEFOR  player 
will  be  the  same  as  an  OPFOR  PIO.  Also,  two  PIOs  will  "share"  an 
LPN  upon  occasion. 

Qtliy  ~  This  term  refers  to  the  period  of  time  between 

the  occurrence  of  an  ROMS  event  and  the  receipt  of  the  event  at 
the  C-station,  or  ROMS  master  control  station.  The  delay  time  is 
passed  to  the  C-station  as  part  of  an  event  message.  In  general, 
if  ROMS  coverage  is  adequate,  the  delay  time  will  be  less  that  or 
equal  to  the  time  between  pollings,  which  is  assumed  to  be  5 
seconds  at  the  NTC.  When  the  vehicle  is  not  in  constant  range  or 
line  of  sight  of  the  relay/  repeater  stations  (A-stations) , 
however,  the  delay  is  increased  significantly. 

Pairing  -  For  the  purposes  of  this  document,  the  term  pairing 
refers  to  an  ROMS  sensor-illumination  event.  When  a  sensor  is 
illuminated  by  a  MILES  laser,  two  pieces  of  information  can  be 
decoded,  the  intensity,  yielding  the  result  (HIT,  NEAR  MISS,  or 
KILL),  and  some  form  of  identification.  The  level  of 
identification  depends  on  the  result;  for  a  NEAR  MISS  only  the 
general  category  (heavy  or  light  weapon)  can  usually  be 
determined,  but  for  a  HIT  or  KILL  outcome  the  firer  can  be 
identified  by  weapon  type  code.  A  matched  pairing  is  achieved 
when  the  firer  can  also  be  determined  by  matching  event  times. 

Most  pairings  are  unmatched  for  any  of  several  reasons: 

(1)  Un instrumented  Firer  (MILES  but  no  B-unit) 

(2)  Firer  or  target  "hidden"  from  ROMS  relay/repeater 
stations,  precluding  event  transmission  during  "window"  allowed 
for  matching  events,  or 

(3)  Base  time  discrepancy  between  CIS  and  ROMS,  preventing 
time  correlation. 


ElliHfl  Event  Analysis 


Firing  data  were  exaained  for  active  periods  of  each  of  the 
three  target  mission  segments.  The  periods  were  0500-0600  for 
Armored  segment  12  and  Mechanized  segment  19,  and  0500-0530  for 
Mechanized  segment  8.  The  process  used  was  to  attempt  to  match 
each  fire  event  in  the  ROMS  data  with  a  corresponding  entry  in  the 
NTCDRS  FIRING  table.  Two  rules  were  followed  regarding  the 
selection  of  ROMS  data  included  in  the  statistics.  First,  ROMS 
events  with  delays  of  greater  than  25  seconds  were  excluded  in  an 
attempt  to  replicate  the  action  of  CIS  realtime  software.  Second, 
for  OPFOR  BMP  vehicles,  the  ROMS  indicates  a  number  of  machine  gun 
firings,  while  they  are  conspicuously  absent  from  the  NTCORS 
FIRING  table.  The  number  of  ROMS  BMP  machine  gun  fire  events  is 
shown,  but  not  included  in  the  comparison  statistics.  Table  lll-l 
presents  the  results  of  this  effort. 

The  table  shows,  for  each  mission  segment  and  vehicle  type, 
the  number  of  fire  events  logged  by  the  ROMS,  the  number  of 
entries  in  the  NTCORS  Firing  table,  and  the  number  of  events  for 
which  the  two  sources  agree.  When  agreement  is  less  than  perfect, 
the  percentage  of  ROMS  events  that  agree  with  NTCORS  table  entries 
is  shown  in  parentheses. 

Two  conclusions  may  be  drawn: 

(1)  The  two  sources  agree  very  well.  One  segment  shows 
perfect  agreement,  while  the  other  two  are  very  close,  at  98  and 
99  percent.  The  overall  agreement,  totalling  fire  events  for  all 
three  segments,  is  99  percent. 

(2)  There  appears  to  be  a  problem  with  the  NTCORS  regarding 
BMP  machine  gun  firings.  While  machine  gun  firings  are  not  a 
significant  killer  on  the  battlefield,  they  are  good  indicators  of 
general  battlefield  activity.  In  addition,  they  are  captured  by 
the  NTCORS  for  both  BLUFOR  and  OPFOR  tanks. 
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111^2^2  Pairing  Events  Compar i son 

Pairing  data  were  examined  for  active  periods  of  each  of  the 
three  mission  segments.  The  periods  were  0500-0530  for  both 
Mechanized  segment  8  and  Armor  segment  12.  and  0500-0600  for 
Mechanized  segment  19. 

The  analysis  of  pairing  events  was  slightly  more  complicated 
than  the  firing  event  analysis  because  the  ROMS  pairing  data 
potentially  appear  in  two  different  NTCRDS  tables,  the  PAIRING 
table  and  the  PLYRCHANGE  table.  An  additional  factor  is 
introduced  by  the  fact  that  Training  Analysis  and  Feedback  (TAF) 
personnel  can  enter  information  on  their  workstations  which  ends 
up  in  one  or  both  of  the  NTCRDS  tables,  but  is  not  in  the  ROMS  log 
data . 

It  is  important  to  keep  in  mind  the  definition  of  the  term 
"pairing"  as  used  in  this  analysis:  an  ROMS  HIT,  NEAR  MISS,  or 
KILL  event  caused  by  laser  illumination  of  MILES  sensors.  Table 
III-2  contains  the  summary  statistics  for  the  pairing  study.  The 
table  is  arranged  to  show  the  total  number  of  pairings  from  both 
the  ROMS  log  and  the  NTCORS.  The  NTCDRS  column  contains  the 
number  of  entries  in  the  PAIRING  table  except  for  controller  gun 
kills,  which  are  in  the  PLYRCHANGE  table.  The  ROMS  log  events 
which  are  properly  discarded  by  the  CIS  are  enumerated,  and  the 
total  number  of  events  which  agree  is  shown. 

There  are  three  primary  reasons  that  ROMS  events  are  properly 
discarded  by  the  CIS  software: 

(1)  Sometimes  the  electronic  instrumentation  on  a  vehicle 
malfunctions  and  "floods"  the  ROMS  with  event  messages.  These  can 
either  be  the  repeat  of  a  valid  message  or  the  generation  of  bogus 
messages.  CIS  software  can  be  instructed  to  ignore  players  which 
generate  events  incessantly.  For  example,  in  Armored  segment  12, 
55  events  from  one  player  were  discarded  from  both  the  ROMS  and 
the  CIS  data. 

(2)  If  the  message  is  delayed  more  than  25  seconds  from 
occurrence  to  receipt  at  the  C-station  the  CIS  software  ignores 
it.  This  is  necessary  to  enable  the  real  time  software  to 
maintain  efficiency,  particularly  in  matching  fire  events  with 
pairing  events. 

(3)  When  a  HIT  or  NEAR  MISS  event  is  received  at  the  same 
time  as  a  KILL  for  the  same  player,  it  is  discarded. 

In  addition,  controller  gun  kills  are  retained  by  the  NTCDRS 
and  put  in  the  PLYRCHANGE  tablt  rather  than  the  PAIRING  table. 


i 


Table  III- 

2  Pairing 

Data 

Tabulation 

Mechanized 
Segnent  8 
(0500-0530) 

Arnored 
Segnent  12 
(0500-0530) 

Mechanized 

Segnent  19 
(0500-0600) 

ROMS 

NTCRDS 

ROMS 

NTCRDS 

ROMS 

NTCRDS 

Total  Pairings 

96 

94 

148 

147 

195 

175 

Noisy  Sensors 

— 

— 

55 

55 

— 

— 

Excessive  Delay 

10 

— 

3 

— 

8 

— 

Duplicate  HIT/ 
NEAR  MISS 

2 

— 

6 

— 

3 

-- 

Controller  Gun 
Kills 

3 

(3) 

4 

(4) 

7 

(5) 

Potential  Pairing 
Matches 

81 

94 

80 

92 

177 

175 

Matches 

80 

80 

150 

Unexplained 

1 

14 

0 

12 

27 

25 

Note:  The  nuMbers  in  parentheses  represent  the  nueber  of 

controller  gun  entries  1n  the  PLYRCHAN6E  table  that  natch 
ROMS  log  events. 


As  can  be  seen  in  Table  III-2  tMo  of  the  segaents  show  that 
virtually  all  ROMS  pairings  appear  in  the  CIS  pairing  table  (80/81 
for  M008  and  80/80  for  A012).  However,  each  of  those  segments 
also  contained  a  significant  nuaber  of  NTCDRS  pairing  table 
entries  which  could  not  be  traced  back  to  the  ROMS  log.  As 
aentioned  above,  it  is  possible  for  TAP  personnel  to  aake  entries 
via  their  graphics  tables  which  influence  the  pairing  table.  This 
aay  be  the  priaary  reason  for  the  reaaining  aisaatches.  although 
no  records  are  aaintained  at  the  TAP  to  verify  it. 

The  third  segaent  M019  had  a  large  nuaber  of  aisaatches  for 
both  sources.  Over  15k  of  the  ROMS  pairings  could  not  be  traced 
to  the  CIS  pairing  table.  Closer  scrutiny  showed  that  the  27 
aisaatches  were  contributed  by  six  players.  Of  the  six,  only  one 
also  had  pairings  froa  the  two  sources  that  aatched.  A  possible 
explanation  is  that  the  players  were  loaded  properly  for  the  ROMS 
systea  to  poll  thea  and  retrieve  events,  but  were  either  not 
loaded  into  the  CIS,  or  were  iaproperly  loaded.  The  one  player 
which  also  had  valid  aessages  had  thea  after  the  invalid  aessages, 
so  he  aay  have  been  activated  later  in  the  segaent. 

"Killeri::  aftifiaslrilian 

Pigures  II1-2  and  I1I-3  graph  kills  by  weapon  type,  and  are 
intended  as  a  deaonstration  of  an  additional  potential  use  of  the 
ROMS  data  that  cannot  be  supported  by  CIS  data.  The  figure  was 
generated  directly  froa  ROMS  KILL  event  data  for  the  entire  tiae 
periods  of  the  three  aission  segaents  exaained  earlier.  Ouplicate 
kills,  (the  saae  player  killed  aore  than  once)  were  deleted.  The 
data  as  presented  aay  prove  useful  for  drawing  soae  general 
trends,  but  one  point  should  be  raised  concerning  the  reliability 
of  the  data: 

MILES  weapon  codes  which  do  not  absolutely  indicate  force 
(BLUEPOR  or  OPPOR)  were  not  included  in  the  graphs  because  such 
kills  cannot  be  absolutely  attributed  to  either  side.  Por 
exaaple,  the  saae  MILES  weapon  type  code  is  used  for  aachine  guns 
for  both  sides. 

Even  allowing  for  the  uncertainty  of  the  data,  one  thing 
stands  out.  All  three  segaents  were  defensive  scenarios  for  which 
the  killers  aight  be  assuaed  to  be  roughly  equal.  Por  the  OPPOR, 
this  is  the  case.  Por  the  BLUPOR,  however,  there  is  a  significant 
difference.  Por  segaents  A012  and  M008,  the  distributions  are 
roughly  equal,  with  tanks  being  the  aain  killer  at  over  60k,  but 
for  segaent  M019,  the  TOMs  doainate  at  over  70k,  relegating  the 
tanks  to  less  than  20k.  Using  this  indication  as  a  stiaulus,  the 
researcher  aight  then  use  the  other  NTC  data  sources  to  see  why 
there  is  such  a  difference.  The  other  sources  that  could  be  used 
include  the  Operations  Order,  the  Take  Hoae  Package,  the  NTC 
workstation,  and  the  NTCORS. 


The  final  investigation  Mas  concerned  with  ROMS  delay  tines. 
The  delay  tine  was  defined  earlier  : 

Delay  Hie  -  This  tern  refers  to  the  period  of  tine  between 
the  occurrence  of  an  ROMS  event  and  the  receipt  of  the  event  at 
the  ROMS  naster  control  station  (C-station).  The  delay  tine  is 
calculated  by  the  on-board  nicroconputer  and  passed  to  the  C- 
station  as  part  of  each  event  nessage.  In  general,  if  ROMS 
coverage  is  adequate,  the  delay  tine  will  be  less  than  or  equal  to 
the  tine  between  pollings,  which  is  assuned  to  be  5  seconds  at  the 
NTC.  When  the  vehicle  is  not  in  constant  range  or  line  of  sight 
of  the  relay/repeater  stations  (A-  or  0-  stations)  however,  the 
delay  is  increased  significantly. 

Use  of  the  delay  tine  allows  CIS  real  tine  software  to 
deternine  the  event  tine  with  a  great  deal  of  accuracy,  which 
supports  firer-target  pairing.  In  addition,  the  CIS  software  can 
discard  those  events  which  are  so  "old"  as  to  be  useless.  The 
delay  threshold  used  at  the  NTC  appears,  fron  exanination  of  ROMS 
data,  to  be  25  seconds.  Messages  with  delay  tines  greater  than 
the  threshold  are  sunnarily  discarded. 

The  conparison  of  ROMS  and  CIS  data  showed  that  there  is 
apparently  no  "standard"  tine  used  in  both  systens.  The  tine 
attached  to  CIS  events  was  neither  the  base  (C-station)  tine,  nor 
the  adjusted  event  tine.  It  appeared  to  be  an  adjusted  tine, 
because  the  tines  between  events  natched  for  both  sources,  but  it 
was  consistently  different,  and  later,  than  the  ROMS  event  tine. 

Base  data  for  the  delay  figures  came  fron  the  three  segnents 
described  earlier.  In  order  to  increase  the  sanple  size,  the 
entire  mission  segment  periods  were  used.  Two  figures  are 
included.  Figure  III-4  shows  a  percentage  distribution  for  events 
with  delays  less  than  ten  seconds,  and  Table  III-3  shows  the 
percentage  distribution  of  delay  times  from  0-100  seconds  in  25 
second  increments. 

Figure  III-4  shows  that  the  distribution  of  delay  tines  under 
ten  seconds  is  very  similar  for  the  three  nission  segments 
selected.  It  also  shows  that  the  distributions  peak  fron  two  to 
five  seconds,  with  approxinately  equal  distributions  at  one  and 
six  seconds.  The  indication  is  that  polling  is  not  being 
maintained  at  every  five  seconds,  but  appears  to  be  close  to  six 
seconds.  This  condition  could  be  caused  by  a  number  of  factors, 
including  heavy  system  loading. 

Table  1 1 1-3  shows  the  percentages  of  delay  times  for  messages 
that  are  retained  by  CIS  software  (less  than/  equal  to  25  seconds) 
and  in  25  second  increments  up  to  lOO-i-  seconds.  This  table  shows 
that  Armored  Segment  12  had  the  worst  quality,  with  more  than 
12.5%  of  events  being  deleted,  while  Mechanized  Segment  19  had 
more  than  98.5%  events  within  bounds. 


Table  1II-3  Delay  Tine  Distribution 


Delay  Period 
i§fi£2ndsl 

0-25 

26  -  50 

51  -  75 

76  + 


Mechanized 
Ssflffint  28 

93.61  % 

1 .68  « 

0.82  % 

3.89  % 


Areored 

Sfiflisnl  12 

87.36  % 

8. 17  « 

2.59  % 

1 .89  « 


Meehan i zed 
Seawent  19 

98.66  % 

0.62  \ 

0.05  % 

0.67  % 


>** 


Mechanized  Segment  19 

Figure  III-4  Percentage  Distribution  of  Delay  Times  Under  Ten  Seconds 


IV.  CONCLUSIONS 


The  results  of  the  study  support  several  conclusions: 

(1)  The  CIS  (NTCDRS)  data  appear  to  aatch  the  RONS  data  with 
sufficient  fidelity  to  justify  the  use  of  either  data  source 
interchangeably  in  research.  The  basis  of  this  conclusion  is  the 
high  percentage  of  coaparison  between  the  two  sources  for  the  data 
eleaents  coapared.  Extrapolating  this  result  to  encoapass  other 
data  eleaents  in  either,  or  both,  sources  without  a  closer 
exaaination  of  each  data  eleaent  is  not  advocated;  that  the  level 
of  coaparison  was  high  for  the  saaple  chosen  aay  be  seen  as  an 
indicator  that  the  two  sources  are  consistent,  but  liaitations  of 
the  study  indicate  that  acre  study  is  required  before  any 
definitive  stateaents  can  be  aade. 

(2)  There  are  data  eleaents  available  froa  the  RONS  log  that 
are  not  currently  available  froa  the  CIS  log.  For  exaaple.  while 
the  field  event  PAIRING  aessage  carries  a  weapon  type  indication 
along  with  the  result  (HIT.  NEAR  MISS,  or  KILL),  this  inforaation 
is  not  present  in  the  NTCDRS  PAIRING  table.  This  indicates  only 
that,  if  the  data  are  present  in  the  CIS  log  file  data,  they  are 
not  translated/  loaded  into  the  NTCDRS  table.  Due  to  a  lack  of 
docuaentation  on  the  foraat  of  the  CIS  log  files,  it  is  iapossible 
to  know  if  these  data  are  present.  If  the  data  are  not  present  in 
the  CIS  files,  then  RDMS  data  aust  be  used  to  suppleaent  the 
NTCDRS.  Accordingly,  retention  of  RDMS  log  tapes  becoaes 
iaportant  any  future  NTC  research  efforts. 

Several  other  insights  were  gained  during  the  course  of 
the  study.  A  significant  aaount  of  use  of  the  NTCDRS  left  a  clear 
iapression  that  the  design  of  the  NTCDRS  is  inadequate  to  support 
the  number  and  breadth  of  NTC  research  efforts  currently 
contemplated.  While  it  was  possible  to  achieve  some  measure  of 
success  in  using  NTCDRS  tables,  the  gains  were  achieved  with  much 
difficulty,  owing  mostly  to  the  awkward  design  of  the  NTCDRS. 

The  database  tables  appear  to  support  a  specific,  and  very 
restricted  set  of  reports,  and  most  tables  have  proved  of  little 
use  in  deriving  tables  to  generate  alternative  reports.  The  index 
keys  to  the  various  tables  force  a  circuitous  query  structure, 
making  the  preparation  of  queries  that  seem  routine  very  time- 
consuming.  Some  tables  lack  inforaation  to  allow  the  information 
they  contain  to  be  used  in  conjunction  with  other  tables.  As  one 
exaaple,  many  of  the  tables  use  a  three-  character 
player_identif ication  (PID)  field  as  an  index.  As  conditions 
exist  presently  at  the  NTC,  these  names  are  not  unique.  This 
makes  the  correlation  of  pairing  data  difficult,  because  although 
the  table  contains  a  result  of  a  pairing  against  a  PID,  if  that 
PID  happens  to  be  one  of  the  duplicates,  there  is  not  enough 
inforaation  to  ascribe  the  pairing  to  the  proper  player. 

For  example,  NTCDRS  access  to  NTC  data  is  limited  to  one 
mission  segment  at  a  time,  while  several  upcoming  studies  compare 
several  mission  segments.  To  accomplish  this  within  the  NTCDRS 


context,  the  user  has  to  create  an  additional  database,  then  fill 
it  by  retrieving  data  from  the  data  bases  being  studied.  Only 
then  can  the  researcher  do  queries  and  develop  statistical 
measures . 

Similarly,  the  NTCDRS  contains  only  digital  data 
from  the  CIS  log.  There  are  other  data  sources  that  are 
not  digital  in  form,  such  as  Take  Home  Packages  (THPs), 

After  Action  Reviems  (AARs),  and  communications  data,  that 
can  provide  invaluable  information  to  the  researcher  if  they  can 
be  put  in  a  usable  form  and  incorporated  into  the  NTCORS. 

Finally,  the  quality  of  the  NTC  data  is  questionable, 
particularly  for  pairings.  This  seems  to  be  independent  of  the 
source,  as  the  two  sources  compared  very  well.  The  samples 
examined  in  this  study,  for  example,  showed  that  matched  pairings, 
for  which  a  firer  was  identified  for  a  pairing  event  (HIT,  NEAR 
MISS,  or  KILL),  comprised  less  than  10%  of  the  total  number  of 
pairings.  Even  considering  the  ruggedness  of  the  Ft  Irwin  terrain 
and  a  natural  difficulty  with  ROMS  coverage,  this  seems  very  poor. 
It  may  be  that  no  single  cause  is  responsible  for  the  poor 
quality,  and  it  derives  from  a  number  of  causes,  including  poor 
coverage,  instrumentation  failure,  good  cover  and  concealment 
practices,  and  poor  time-correlation  between  the  ROMS  and  CIS. 
Whatever  the  cause,  the  quality  of  the  data  directly  affects  the 
quality  of  the  research  that  can  be  based  on  it. 


APPEHeiX  A  r  FIRING  OAIA 


This  appendix  contains  more  detailed  information  on  the 
firing  data  comparison  documented  in  Section  III.  It  contains  a 
list,  per  segment,  of  the  number  and  type  of  firings  per  vehicle 
type.  Notes  are  included  to  explain  most  discrepancies. 
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Task  Force 
Mission 


Meehan i zed 
Defend  in  Sector 


Firing  Suenary  For  BLUFOR  Players 


Suaaary 


BLUFOR  Tanks  (0500-0600) 


Player 

ROMS 

—  ROMS 

Log  — 

—  CIS 

Log  — 

Name 

LPN 

105MM 

COAX 

105MM 

COAX 

140 

58 

44 

0 

44 

0 

130 

42 

1 

0 

1 

0 

32C 

38 

6 

0 

6 

0 

33C 

45 

4 

0 

4 

0 

66C 

179 

2 

35 

2 

35 

TOTALS 

57 

35 

57 

35 

Firing  Summary  For  BLUFOR  APCs  (0500-0600) 


Player 

Name 

E16 


ROMS 

LPN 

210 


ROMS  Log 
I0W_Shots 
2 


CIS  Log 
IfiW  Shots 
2 


Firing  Summary  For  OPFOR  Players 
Firing  Summary  for  BMPs  (0500-0600) 


Player 

ROMS 

-  ROMS 

Log 

— 

--  CIS 

Log 

-- 

Name 

LPN 

73MM 

SAG 

MG 

73MM 

SAG 

MG 

Notes 

150 

81 

2 

1 

2 

2 

1 

0 

1 

211 

27 

1 

0 

0 

1 

0 

0 

410/ 

56 

2 

2 

2 

1 

1 

0 

1.2 

411 

1 

1 

0 

1.2 

413 

57 

1 

0 

7 

1 

0 

0 

414/ 

59 

6 

0 

11 

3 

0 

0 

1.3 

415 

3 

0 

0 

1.3 

416 

60 

0 

1 

0 

0 

1 

0 

422 

62 

12 

3 

9 

12 

3 

0 

1 

870 

111 

2 

0 

2 

2 

0 

0 

1 

Totals 

26 

7 

33 

26 

7 

0 

ol 


Firing 

Summary 

for  OPFOR  Tanks  (0500-0600) 

Player 

ROMS 

—  ROMS  Log  “ 

-  CIS  Log 

— 

Name 

LPN 

125MM 

COAX  125MM 

COAX 

Notes 

A23 

90 

8 

38 

8 

29 

4 

B24 

98 

1 

0 

1 

0 

B66 

94 

50 

2 

50 

2 

D13 

167 

15 

7 

15 

7 

015 

158 

28 

10 

28 

10 

026 

169 

1 

18 

1 

18 

034 

213 

12 

99 

12 

102 

035 

172 

1 

0 

1 

0 

036 

100 

1 

0 

1 

0 

HQ2 

176 

2 

10 

2 

10 

5 

TOTALS 

119 

T84 

Ti9 

178 

OPFOR 

Notes  : 

1)  Machine  gun  fire  events  reported  on 

the 

ROMS 

log 

are  not 

present 

in  INGRES  tables. 

either  because 

they 

are 

not  on  the  CIS 

log  or 

because 

they  are  ignored  by  NTCORS. 

2)  ROMS  LPN  56 

contributed 

events  to  two 

CIS 

PIOs. 

410 

and  411. 

3)  ROMS  LPN  59 

contributed 

events  to  two 

CIS 

PIOs. 

414 

and  415. 

4)  Three  of  the  ROMS  COAX 

fire  events  had 

unacceptable 

de  1  ays . 

5)  In 

addition 

,  one  fire 

event  ascribed 

to  a 

TOW 

weapon  type  was 

recorded  on  the 

ROMS  log. 

and  included  in 

the 

INGRES  FIRING  table 

with  no 

weapon 

type. 

Task  Force  :  Mechanized 
Segaent  :  08 

Mission  :  Defend  Battle  Position 


Firing  Suaaary  For  BLUFOR  Players 


Summary 

for 

BLUFOR  Tanks  (0500 

-0530) 

Player 

ROMS 

—  ROMS 

Log  — 

—  CIS 

Log  — 

Name 

LPN 

105MM 

COAX 

105MM 

COAX 

Notes 

32C 

154 

1 

0 

1 

0 

22C 

171 

3 

4 

3 

4 

210 

197 

5 

0 

5 

0 

1 

220 

198 

16 

0 

16 

12C 

202 

3 

0 

2 

0 

2 

23C 

204 

6 

0 

6 

0 

TOTALS 

34 

4 

33 

4 

Firing 

Summary  For 

BLUFOR  APCs 

(0500-0530) 

Player 

ROMS 

ROMS  Log 

CIS  Log 

Name 

LPN 

T0W_5hots 

TOW  Shots 

Notes 

E12 

116 

1 

1 

? 

189 

2 

0 

3 

E43 

231 

1 

1 

E44/ 

214 

4 

3 

4 

E45 

1 

4 

Totals 

8 

*~6 

BLUFOR  Notes: 

1)  ROMS  LPN  197  contributed  events  both  for  PID  21D.  a  BLUFOR 
tank,  and  for  PIO  680.  an  OPFOR  BMP. 

2)  One  fire  event  for  LPN  202  was  deleted  by  the  CIS  because  of 


excessive  delay  time. 

3)  ROMS  LPN  189  had  two  TOW  shots.  Both  had  excessive  delay 
times,  causing  the  CIS  software  to  discard  them. 

4)  ROMS  Logical  Player  number  214  events  were  applied  to  both 
player  E44  and  player  E45  at  the  CIS. 
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Task  Force 

Segment 

Mission 


Meehan i zed 
08 

Defend  Battle  Position 


Firing 

Summary 

For  OPFOR  Players 

Firing 

Summary 

for  BMPs  (0500-0530) 

Player 

ROMS 

-  ROMS 

Log 

-- 

--  CIS 

Log 

-- 

Name 

LPN 

73MM 

SAG 

MG 

73MM 

SAG 

MG 

Notes 

322 

41 

8 

1 

0 

8 

1 

0 

323 

42 

1 

0 

0 

1 

0 

0 

325/ 

43 

10 

0 

0 

2 

0 

0 

1 

326 

8 

0 

0 

1 

327 

44 

3 

0 

0 

3 

0 

0 

331 

45 

9 

0 

0 

9 

0 

0 

334 

46 

1 

0 

0 

1 

0 

0 

336 

47 

1 

0 

0 

1 

0 

0 

48 

1 

0 

0 

1 

0 

0 

680 

197 

4 

0 

0 

4 

0 

0 

2 

Totals 

38 

1 

0 

38 

1 

0 

Firing 

Summary  for 

OPFOR  Tanks  (0500 

-0530) 

Player 

ROMS 

—  ROMS 

Log  — 

--  CIS 

Log  — 

Name 

LPN 

125MM 

COAX 

125MM 

COAX 

023 

56 

1 1 

11 

1 1 

1 1 

? 

76 

1 

0 

A16 

79 

2 

0 

2 

0 

A24 

81 

1 

0 

1 

0 

A36 

84 

0 

34 

0 

6 

B65 

85 

1 

0 

1 

0 

B24 

88 

1 

0 

1 

0 

B33 

90 

4 

0 

4 

0 

016 

99 

1 

0 

1 

0 

HQ2 

102 

4 

0 

4 

0 

015 

215 

3 

0 

3 

0 

TOTALS 

29 

45 

28 

17 

Firing 

Summary  for 

OPFOR  ZSU  23-4 

(0500-0530) 

Player 

ROMS 

ROMS 

CIS 

Name 

LPN 

Log 

Log 

343 

74 

3 

3 

35 


Meehan i zed 
08 

Defend  Battle  Position 


Task  Force 

Segaent 

Mission 


OPFOR  Notes  : 

1)  ROMS  LPN  43  contributed  events  to  PID  325  and  PID  326.  There 
were  also  22  SA-9  (BROM)  FIRE  events  from  this  player,  a11  but  one 
of  which  had  excessive  delay  times.  The  remaining  event  did  not 
match  any  FIRING  table  entries. 

2)  ROMS  LPN  197  contributed  events  both  for  PID  21D.  a  BLUFOR 
tank,  and  for  PID  680,  an  OPFOR  BMP. 


3)  ROMS  LPN  76  had  one  apparently  valid  T72  fire  event  which  did 
not  match  any  FIRING  table  entries. 

4)  ROMS  LPN  84  Had  34  COAX  FIRE  events,  a11  at  the  same  time 
(05:01:47).  29  had  delay  times  greater  than  25  seconds  and  were 
candidates  for  deletion  by  CIS  software.  The  remaining  5  ROMS 
events  did  not  match  directly  with  the  6  CIS  events. 


Rotation  :  85-10  Task  Force  :  Araored 


Segaent 

:  12 

Mission 

;  Defend 

in 

Sector 

Firing 

Suaaary 

For  BLUFOR 

Players 

Suaaary 

for  BLUFOR  Tanks 

(0500- 

0600) 

Player 

ROMS 

—  ROMS  Log 

— 

—  CIS  Log 

-- 

Naae 

LPN 

iasMM  gOAX 

105HM  COAX 

Notts 

aT3 

127 

15 

0 

15 

0 

A21 

128 

28 

0 

28 

0 

A23 

106 

23 

0 

23 

0 

A31 

107 

6 

0 

6 

0 

A35 

188 

0 

1 

0 

1 

A66 

125 

38 

0 

38 

0 

B14/ 

135 

57 

0 

40 

0 

1 

B21 

15 

0 

1 

B22/ 

136 

27 

0 

26 

0 

2 

B23 

1 

0 

2 

B24 

145 

14 

3 

14 

3 

B66/ 

132 

55 

0 

45 

0 

3 

A34 

10 

1 

3 

H6S 

119 

31 

0 

31 

0 

H66 

118 

_i£ 

-iS 

.fi 

TOTALS 

309 

4 

307 

5 

Firing  Suaaary 

For  BLUFOR 

APCs  (0500-0600) 

Player 

ROMS 

ROMS  Log 

CIS  Log 

Naae 

LPN 

TOW. Shots 

Notes 

E36 

104 

1 1 

10 

4 

E42 

88 

2 

Totals 

13 

12 

BLUFOR  Notes: 

1)  RDHS  Logical  Player  nuaber  135  events  Mere  applied  to  both 
player  B14  and  player  B21  at  the  CIS.  Tmo  RONS  log  events  had 
excessive  delay  tiaes  and  Mere  apparently  discarded  by  the  CIS. 

Tmo  aore  events  have  no  apparent  aatch  in  the  INGRES  FIRING  table, 
however  two  events  that  appear  in  the  INGRES  table  have  no 
apparent  aatch  in  RONS  log  data. 

2)  ROMS  Logical  Player  nuaber  136  events  were  applied  to  both 
player  B22  and  player  B23  at  the  CIS. 

3)  RDHS  Logical  Player  Nuaber  132  events  were  applied  to  CIS 

players  A34  and  B66.  A34  had  one  COAX  firing  event  in  the  INGRES 

table  that  was  not  in  the  ROMS  data. 

4)  One  ROMS  fire  event  had  an  excessive  delay  tiae  (128  seconds) 
and  was  discarded  by  the  CIS. 


Task  Force  :  Arnored 

Segaent  :  12 

Mission  :  Defend  in  Sector 

Firing  Summary  For  OPFOR  Players 


Firing  Summary  for  BMPs  (0500-0600) 


Player 

ROMS 

-  ROMS 

Log 

— 

—  CIS 

Log 

— 

Name 

LPN 

73HH 

SAG 

MG 

73MM 

SAG 

MG 

Notes 

120 

16 

1 

0 

39 

1 

0 

0 

1 

121 

17 

2 

0 

0 

2 

0 

0 

132 

21 

1 

0 

0 

1 

0 

0 

133 

22 

7 

0 

12 

7 

0 

0 

1 

150 

25 

0 

2 

0 

0 

2 

0 

210 

24 

0 

2 

0 

0 

2 

0 

216 

91 

1 

1 

0 

1 

1 

0 

217 

34 

1 

2 

0 

1 

2 

0 

220 

28 

4 

0 

38 

4 

0 

0 

1 

227 

57 

0 

1 

0 

0 

1 

0 

230 

33 

13 

3 

0 

12 

2 

0 

2 

250 

36 

5 

3 

0 

5 

3 

0 

311 

151 

1 

0 

0 

1 

0 

0 

312 

167 

7 

0 

21 

7 

0 

0 

1 

323 

187 

2 

0 

2 

2 

0 

0 

1 

325 

190 

3 

0 

2 

3 

0 

0 

1 

326 

8 

1 

0 

0 

1 

0 

0 

330 

197 

1 

0 

0 

1 

0 

0 

333 

25 

3 

1 

9 

3 

1 

0 

1 

336 

198 

8 

0 

16 

8 

0 

0 

1 

337 

196 

15 

0 

13 

15 

0 

0 

1 

411 

49 

5 

0 

1 

5 

0 

0 

1 

414 

50 

1 

0 

0 

1 

0 

0 

422 

95 

1 

0 

0 

1 

0 

0 

430 

47 

1 

0 

3 

1 

0 

0 

1 

435 

55 

1 

0 

0 

1 

0 

0 

650 

83 

5 

0 

5 

5 

0 

0 

1 

871 

111 

12 

0 

50 

12 

0 

0 

1 

HQ3 

1 

3 

0 

0 

3 

0 

0 

HQ6 

82 

_ 

1 

0 

0 

1 

0 

Totals 

104 

16 

Ill 

103 

15 

0 

38 


Firing  Suaaary  for  OPFOR  Tanks  (0500-0600) 


Player 

ROMS 

—  ROMS 

Log  — 

—  CIS 

Log  — 

Nane 

LPN 

125MM 

COAX 

125MM 

COAX 

Notes 

A23 

206 

3 

56 

3 

24 

3 

613 

70 

2 

2 

2 

2 

614 

87 

6 

62 

6 

26 

4 

635 

174 

7 

14 

7 

14 

636 

89 

16 

18 

16 

8 

5 

013 

214 

5 

0 

5 

0 

014 

78 

13 

0 

13 

0 

016 

79 

15 

0 

15 

0 

023 

97 

14 

0 

14 

0 

033/ 

100 

1 

130 

1 

0 

6 

034 

0 

128 

6 

TOTALS 

82 

282 

82 

200 

OPFOR  Notes  : 

1)  Machine  gun  fire  events  reported  on  the  ROMS  log  are  not 
present  In  INGRES  tables,  either  because  they  are  not  on  the  CIS 
log  or  becasue  they  are  ignored  by  NTCDRS. 

2)  One  73HM  fire  event  and  one  SAGGER  fire  event  for  player  230 
Mere  discarded  by  CIS  software  because  the  delays  between  the  tine 
the  events  happened  and  the  tine  they  were  received  by  the  ROMS  C- 
Statlon  exceeded  25  seconds. 

3)  Player  A23  natched  all  125MM  firings.  Coax  firings  nisnatched 
prinarlly  because  of  excessive  delay  tines.  Of  the  56  COAx  firing 
events,  only  21  had  acceptable  delays  (less  than/  equal  to  25 
seconds).  This  neans  that  the  INGRES  FIRING  table  had  3  nore  coax 
firings  than  It  should  have. 

4)  Player  B14  natched  all  nain  gun  firings,  but  nisnatched  on  the 
coax  fire  events  due  to  excessive  delay  tines.  For  player  614,  26 
coax  fire  events  had  acceptable  delay  tines  (less  than/  equal  to 
25  seconds),  neaning  that  the  two  sources  natched  exactly. 

5)  Player  636  natched  all  nain  gun  firings,  but  nisnatched  on  the 
coax  fire  events  due  to  excessive  delay  tines.  For  player  636,  9 
coax  fire  events  had  acceptable  delay  tines  (less  than/  equal  to 
25  seconds),  leaving  one  ROMS  event  unnatched. 

6)  ROMS  LPN  100  contributed  events  to  CIS  players  033  and  034. 
Two  ROMS  coax  fire  events  were  left  unpaired  for  this  player. 
Oelays  were  within  Units  for  all  events. 
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appendix  B  -  PAIRING  DAIA 

This  appendix  contains  More  detailed  inforaation  on  the 
pairing  data  comparison  docuMented  in  Section  III.  It  contains  a 
complete  listing  of  all  pairings  contained  in  either  the  ROMS  tape 
data  or  the  NTCDRS  PAIRING  table  for  the  time  segment  selected. 
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